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© A reconfigurable sequential processor includes a 
data bank for storing data to be processed; a prog- 
rammable logic block address generator for address- 
ing data in the data bank; a programmable logic 
block arithmetic unit responsive to the data bank for 
processing the data addressed by the programmable 
logic block address generator; an address generator 
: ; hardware configuration file having a plurality of con- 
figuration files for configuring the programmable log- 
ic: block address generator in one of a plurality of 
.addressing configurations in response to an address 
operational code; an arithmetic hardware configura- 
tion file having a plurality of configuration files for 
configuring the programmable logic block arithmetic 
unit in one of a plurality of processing configurations 
\ in response to an arithmetic operational code; and 
• means for delivering a series of operational codes to 
each configuration file for enabling th£ * program- 
mable logic bjock address generator arid . the prog- 
rammable logic block arithmetic unit to be config-. 
ured to perform sequentially a corresponding series 
of arithmetic logic operations on the data in the data 
bank: . 
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* FIELD OF INVENTION 

This invention relates to a reconfigurable se- 
quential processor, and more particularly to such a 
processor which is reconfigurable over time to im- 
plement a series of address generators and 
arithmetic logic units for performing a correspond- 
ing sequence of operations on data. 

BACKGROUND OF INVENTION 

Conventional data processing systems such as 
image data processors require extensive hardware 
to perform a series of arithmetic logic operations 
on the data. For example/ image data requires the 
operations of image acquisition, spatial filtering, 
temporal filtering, histogram equalization, image 
display, to name just a few. Each such operation 
requires a separate hardware implementation in 
separate boards or separate gate arrays. Such im- 
plementations are expensive and are relatively in- 
efficient in the sense that while all the necessary 
hardware is always present it is being utifized only 
a small part of the time during the period when its 
particular operation in the series is called for. The 
hardware actually involves two components: an ad- 
.'_ dress generator for selecting the pixel addresses in 
the sequence called for by the operation, and an 
arithmetic logic unit which actually performs the 
operation on the sequenced data. 

The escalation of hardware required is even 
greater in pipeline systems, which feature fixed 
image data banks. A pipeline system is one in 
which a number of image processing operations 
are being performed on a number of different 
frames of pixels as the frames are shifted through 
the pipeline or a series of processors. In one vari- 
ety of pipeline system where the image data is 
fixed and does not move through the pipeline, each 
framb.must be serviced by a sequence of address 
generators and associated arithmetic logic units; 
_ tfiat ^requires two l^rge multiplex*^ with 
massive switching capability to connect the right 
pair of address generators and arithmetic logic 
units to each frame in the proper sequence. 

V SUMMARY OF INVENTION 

It is therefore an object of this invention to 
provide a reconfigurable sequential processor. 
; >. :.\ It is a further object of this; invention to provide 
such a reconfigurable ^uential processor: whose 
reconfiguration is controlled by software. 

It is a further object of this invention to provide 
such a reconfigurable sequential processor which 
uses ttMt same gate arrays reconfigurable in time to 
: implement specific generators and arithmetic logic 
units, respectively, in a number of different sequeh- 
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tial operations on the same data. 

ft is a further object of this invention to provide 
. such a reconfigurable sequential processor which 
provides the simultaneous processing available in 

s pipeline systems with stationary data banks yet 
eliminates the need for massive multiplexer switch- 
ing capability. 

ft is a further object of this invention to provide 
such a reconfigurable sequential processor in 

w which the processing algorithm can be changed 
easily and quickly without hardware replacement 

The invention results from the realization that a 
truly effective and economical data processor can 
be achieved by using an address generator and an 

is arithmetic unit which can be easily reconfigured 
under software control to emulate a number of 
different address sequences and arithmetic oper- 
ations, respectively, using the same programmable 
logic blocks. 

20' This invention features a reconfigurable se- 
quential processor including a data bank for storing 
data to be processed and a programmable logic 
block address generator for addressing data in a 
data bank! A programmable Jogic block arithmetic 

25 unit responds to the data bank for processing the 
data addressed by the programmable logic block 
address generator. An address generator hardware 
configuration file has a plurality of configuration 
files for configuring the programmable logic block 

30 address generator in one of a plurality of address 
configurations in response to an address oper- 
ational code. An arithmetic hardware configuration 
file has a plurality of configuration files for configur- 
ing the programmable logic block arithmetic unit in 

35 one of a plurality of processing configurations in 
response to an arithmetic operational code. There 
are means for delivering a series of operational 
codes to each configuration file for enabling the 
programmable logic block address generator and 

40 the programmable logic block arithmetic unit to be 
configured to perform sequentially a corresponding 
series of arithmetic logic operations on the data in 
the data bank. 

ha preferred embodiment the programmable 

45 logic blocks are programmable gate arrays. The 
means for delivering operational codes may include 
an operational code register for storing the oper- 
ational code in the next configuration for each of; 
the logic blocks and decoder means responsive to 

so the next operational code for selecting from the 

^ hardware configuration files the file cxxrespondin^ 
to that operational code. The address generator '] 
may include a plurality of reconfigurable address 
sets and the arithmetic unit may include a plurality 

55 of reconfigurable arithmetic circuits. The data bank 
may include a plurality of sets of data and the 
recorrfigurable sequential processor may further in- 
clude a plurality of buses for interconnecting each 
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of the address sets and arithmetic units, for the 
corresponding one of the data sets. 

DISCLOSURE OF PREFERRED EMBODIMENT 

Other objects, features and advantages will oc- 
cur to those skilled in the art from the following 
description of a preferred embodiment and the 
accompanying drawings, in which: 

Fig. 1 is a block diagram of a computer contain- 
ing the reconfigurable sequential processor ac- 
cording to this invention; 

Fig. 2 is a more detailed block diagram of the 
reconfigurable sequential processor of Fig. .1- 
according to this invention; 
Fig. 3 Is a flow chart showing the routine which 
effects the reconfiguration of the processor 
shown in Fig. 2; 

F\g. 4 is a list erf the various hardware configura- 
tion files and the respective operational codes 
that can be configured in the processor accord- 
ing to this invention; 

Fig. 5 is a diagram of the fije structure for the 
address generator configuration files in Fig. 4; 
. Fig: 6 is a more detailed block diagram of the 
address generator of Fig. 2; 
Fig: 7 is a diagram similar to that in Fig. 5 of the 
file structure for the arithmetic unit of Fig. 2; 
Fig: 8 is a more detailed block diagram of the 
arithmetic unit of Rg. 2; 

Fig. 9 is a block diagram of a prior art video 
image processing pipeline system; and 
Fig. 10 is a block diagram of a video image 
processing pipeline system constructed in ac- 
cordance with the reconfigurable sequential pro- 
cessor of this invention. ; 
! There is shown in Fig. 1 a computer system 10 
including a reconfigurable sequential processor 12 
according to this invention. The computer may be 
an IBM PC or any other computer haying a key- 
board 14. CPU 16; display 18, and a hard disk 
• storage 20 or any other suitable permanent stor- 
age. The reconfigurable sequential processor: 12 
and CPU 16 typically form plug-in boards on a 
common backplane in a computer. 
: .r Reconfigurable sequential processor 12, Rg. 2, 
includes address generator 22 which selects a se- 
quence of addresses from image data bank 24 that; 
are to be delivered to arithmetic unit 26 ijne at a 
time for processing and then returned to image 
: data bank 24, The particular operation being per- 
formed may be an image acquisition, spatial filter- ; 
ing, histogram, or image display. In each case 
address generator 22, which is implemented by a 
programmable logic block such as a programmable, 
gate array, is configured by a file selected from the 
hardware configuration: file, circuit 28. In like man- 
ner, arithmetic unit 26, which is also implemented: 



by a programmable logic block such as a program- 
mable gate array, is configured according to a file 
selected from hardware configuration files 30. Each 
of. the configuration files 28 and . 30 are loaded 

- s initially with a plurality of files such as from hard 
disk 20 on fines 32 and 34. Subsequently, when an 
operational code identifying a particular process 
arrives at the instruction operational code register 
36 on line 38 from the CPU 16, decoder 39 is 

to enabled to order one or both of the hardware 
configuration files to introduce the desired file into 
the respective units, address generator 22 and 
arithmetic unit 26. ... 

Although only one address bus 40 and one 

76 data bus 42 are shown in Rg. 2, this is not a 
necessary limitation of the invention. For example, 
a plurality of address buses 40a and a plurality of 
data buses 42a (shown in phantom) may be used 
when address generator 22 includes a plurality of 

20 address sets; image data bank 24 includes a plural- 
ity of data sets and arithmetic unit 26 includes a 
plurality of arithmetic circuits. In that case each 
address set in address generator 22 acts as an 
independent address generator and produces a 

25 specific sequence of addresses to the correspond- 
ing data set in image data bank 24. The data from 
memory locations specified by that sequence of 
addresses is processed by a corresponding 
arithmetic circuit in arithmetic unit 26. Each of 

36 these combinations of address set data set and 
arithmetic circuits are interconnected by one of the 
plurality of buses shown, so that simultaneous 
. pipeline-like processing can be accomplished. In 
addition, after the pipeline cycle of processing is 

36 completed the personalities or identities of the ad- 
dress sets can be reshuffled, as can the personal- 
ities or identities of the arithmetic circuits in 
arithmetic unit 26, so that a new cycle of image 
processing can be applied to the data sets in the 

40 image data bank 24, which has not been reshuffled, 
all of this being done without requirement for any 
complex bus multiplexing, v - , ^ " • 

All of the configuration files necessary for a 
particular processing preliminarily 

45 stored in address generator hardware configuration 
files 28 and arithmetic unit hardware configuration 
files 30, from, for example, hard disk 20 over lines 
32 and 34, respectively. Or, each individual file 
may be supplied from hard disk 20 over lines 32 

so and 34 to their respective files 28 and 30 individ- 
ually as they are needed, in either case, computer 
f .; 10 reads from the rommand file, step 50, .the next 
processing technique that is to be executed: for 
example, image: acquisition, spatial filtering, histo- 
: 55 gram operation, or the like. In consequence, it 
identifies the operational code of the specific con- 
figuration required for that processing effort and 
places it, step 52, in instruction operational code 
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register 36, Fig. 2. Following this, decoder 39, Fig. 
2, functions to drive both configuration files 28 and 
30. In step 54, Rg. 3, decoder 39 asks, "Is recon- 
figuration required of the address generator files?" '* 
If the answer is yes,- it reconfigures the address 5 
generator file in step 56 and then executes in step 
58; If the response is no, because, for example, the 
same configuration is required again, the system 
moves directly to execute in step 58. Simulta- 
neously, decoder .39 in step 60 is asking the ques- io 
tk>n, "Is reconfiguration required with respect to the 
arithmetic unit hardware configuration files 30?" If 
the answer is yes, that file is reconfigured in step 
32 and the system moves to execute in step 58. If 
the response is negative, the system moves di- is 
reedy to the execution step 58. Note however that 
execution in step 58 will not take place unless a 
decision has been made in both step 54 and step 
60 indicating that the necessary reconfiguration, if 
any, has been effected in both files. After execution 20 
is complete, the system recycles to look for the 
next operational code in step 52, which is stored in 
the instruction operational code register 36 in re- 
sponse to the next command read in step 50 from 
the computer 10. 25 

A typical list 70 of available processes for 
whiph the system may be reconfigured and the 
associated operational codes are shown in Rg. 4, 
where the table includes sixteen different file 
names identified under the File Name column 72 30 
having corresponding operational codes tabulated 
in the Operational code column 74. Each of the 
files has a field available of 16 kbytes and there are 
sixteen different files in all, from image acquisition 
to image display. The hardware configuration files 35 
could be RAM based or PROM based. In this case, 
where there are sixteen files of sixteen kbytes 
each, the storage necessarily has a capacity of 256 
kbytes. If the block is RAM based it can be re- 
loaded with new files periodically. This feature 40 
makes possible the use of a library of functions 
limited only by the size of the permanent storage, 
e.g., the hard disk. ^ 

-;*Each of the address generator files listed in 
Rg. 4 has a general format 80 as indicated in Rg. 4s 
5, beginning with a header length count block 82 : -- V 
and followed by data frames .1-7. Of course the 
size of the field arid the number of blocks depend 
upon the particular application and ho limitation is 
ine«wit . ■ . V •. '/ so 

, ; : Each data frame 1>7 in Fig. .5 contains 'instruct \iV ; , 
tons to configure the particular component corv 
tained "in the reconfigurable address generator 22. 
Data frame 1 relates to the data source/destination 
control block. Data frame 2 relates to the boundary 55 
conditions ctetectbr/inrtiator blocks Data frame 3 re- : 
lates to the memory array pointer block, data frame 
4 to the adders block, data frame -5 to the address 



generator parameter block, data frame 6 to the 
bank offset generator block, and data frame 7 to 
the memory timing control block. 

All of these blocks are shown jn Fig. 6 as 
constituting a general implementation of the ad- 
dress generator 22. Address generator 22 includes 
a data source destination control 90. Data source 
control 90, Fig. 6, sets the speed of the address 
generation and synchronizes it with the occurrence 
of the corresponding data. Boundary condition de- 
tector initiator 92 detects the beginning and the 
end or the boundaries of an image or a frame of 
data: .it distinguishes the lines from one another 
and the group of fines creating a frame or image 
from the next frame or image. If there is a bound- 
ary condition detected by circuit 92, then jump 
generator 94 directs memory array pointer 96 to 
jump oyer the generated address to the new jump 
address. If a. condition has been indicated by 
boundary condition detector initiator 92, a suitable 
line jump or frame jump increment is introduced. 
Otherwise the generated address is passed from 
the memory array pointer 96 to the adders 98. The 
magnitude of the jump introduced by jump gener- 
ator 94 is determined by the address generator 
parameter block 100. Adders 98 may actually in- 
clude four separate adders 102, 104, 106 and 108 
as an example, which are offset an amount deter- 
mined by bank offset generator 110, which permits 
the generation of four addresses from a single 
address pointer. This is done in certain types of 
filtering where a selected pixel must be convolved 
with a number of adjacent pixels. Memory timing 
control 112 indicates whettier a write or read opera- 
tion is currently being performed and identifies the 
corYect time for the menwy to strobe the ad- 
dresses output from address 102, 104, 106 and 
1 08. If the system is configured as an image, ac- 
quisition address generator then the jump gener- 
ator is eliminated since the data is likely stored 
sequentially and no jump is necessary. If the ad- 
dress generator is configured as a spatial filter then 
the; 90 may be 

eliminated, since the data is taken from the mem- 
ory written back to it without any outside source or 
destination. When address; generator 22 is p^ocm- 
ing a 1 histogram operation the data source destina- 
tion control 90 is again eliminated since the data is 
supplied from and returned to the memory directly, 
and the additional adders 104, 106 and 108 are 
also eliminated since in a histogram operation there 
is no need to • provide . multiple \ offset addresses 
from ajsingle address. When address generator 22 
is configured for image display operation, all of the 
adders as well as the bank offset, generator may be 
eliminated since a simple image display does not 
require multiple address outputs. 

The file format 120, Rjg. 7, for the arithmetic 
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unit 26 is the same as the file format 80 for the 
address, generator 22, Fig. 5. Each data frame 
contains instructions to configure the particular 
component contained in the reconfigurable 
arithmetic unit 26. There Is a header length count 5 
122 followed by seven data frames. Data frame 1 
contains the configuration instructions for the FIFO 
and data in blocks. Data frame 2 relates to the 
adder/subtractor block. Data frame 3 to the multi- 
plier block, data frame 4 to the lookup table, data 10 
frame 5 to the sorter/detector, data frame 6 to the 
ALU control, and data frame 7 to the parameter 
block. All of these blocks are shown in Rg. 7. as 
constituting a general implementation of the 
arithmetic unit 26. 75 

- A generalized block diagram of arithmetic unit 
26, Fig. 8, includes a data-in FIFO 130 which 
receives external data and delivers it to a first 
multiplexer 132. which also receives internal data 
from internal data FIFO 134, A second multiplexer 20 
136 also receives as an input the internal data from 
FIFO 134 as well as the output from parameter 
block 138. Parameter block 138 typically provides 
an identification of the particular table to be se- 
lected in lookup table 140, or the multiplying factor 25 
to be used in multiplier 142, or the offset to be ^ 
used in adder/subtractor 144, as well as threshold 
levels for the detector/sorter circuit 146 and histo- 
gram operations; ALU control allows synchroniza- 
tion of data in FIFO 130, data*xit FIFO 150. and 30 
the various multiplexers 132, 136 and 152, as well 
as internal data FIFO 134. Multiplexer 152 controls 
the input to internal data FIFO t34 from its own 
feedback loop, from memory data in, and from the 
detector/sorter 146 feedback loop. 35 

In the image acquisition mode, arithmetic unit 
26 requires only data-out FIFO 150. lookup table 
140, and data-in FIFO 130, along with parameter 
block 138 and ALU control 148. The remainder of 
the circuits, ail of the multiplexers, the internal data 40 
FIFO, adder/subtractor, and muitipfier are neces- 
sary because an image acquisition system assem- 
bly taking in data from the external FIFO 1 30, may 
transform it using lookup table 1 40 and provide it at 
the output through data-out FIFO 150. 

",; v When arithmetic unit 26 is operating as a spa- 
tial filter, detector sorter 146 may be eliminated 
since ; the detecting and sorting required for histo- 
grams is not used in the spatial filtering in this 
application. so 

/. When arithmetic unit 26 is operating in the 
histogram mode, detector/sorter 146 is again nec- • 
essary. but adder/subtractor 144, multiplier 142 
multiplexers 132 and .136. and data-in FIFO 130* 
aire eliminated since they are unnecessary in histo- ss 
gram operations. In histogram operations the data 
is compared and binned, and multiplying, . adding 
and subtracting are typically not required functions. 



When arithmetic unit 26 is operating in the image 
display mode it requires only internal data FIFO 
134, data output FIFO 150, lookup table 140, pa- 
rameter block 138, and ALU control 148, since data 
is only coming in from the memory, is transformed 
by lookup table data 140 and is put out again to 
the display. The foregoing discussion of the gen- 
eralized and more specific implementation of the 
address generator and arithmetic units to perform 
certain types of processing such as image display, 
histogram, spatial filtering and image acquisition, 
are for purposes of illustration only: the invention 
may be used for many other processing modes not 
limited to these, and may use processing tech- 
niques which differ from the specific implementa- 
tions shown here as they form no part of the . 
instant invention. Address generator 22 and 
arithmetic unit 26, Figs 2, 6 and 8, may be imple- 
mented with field programmable gate arrays avail- 
able from XIUNX Inc. 

Previously,, with respect to Fig. 2, it was ex- 
plained that the address generator 22 and 
arithmetic unit 26 may be interconnected! with the 
image data bank 24 by a number of buses in each 
case. If that is done, a pipeline approach of si- 
multaneous processing of different sets of data 
according to different modes, e.g., image display, 
spatial filtering, histograms, may be accomplished. 
In addition, after each such cycle of processing the 
location of the different address sets and arithmetic 
circuits within the address generator and arithmetic 
unit respectively, may be reshuffled to repeat the 
processing cycle with different data sets. 

In one prior art approach, Fig. 9, a partial 
attempt at this has been made. In a prior art video 
image processing pipeline system 200, Fig. 9, 
there are a plurality of fixed address generators 
202. each of which communicates with a separate 
bus 204 via multiplier, mux, 206, and a second bus 
208 to individual frames or sets of data in memory 
or data bank 210. Similarly, an arithmetic unit 212 
including a plurality ofl fixed arithmetic circuits, is 
interconnected by a plurality of buses 214 through 
mux 216 and a second plurality of buses 218 to 
memory 210. 

la. operation, each •] of, the. address circuits in 
address generator 202 is permanently connected 

. through a specific bus to the mux 206; Mux 206 
then determines which of the Incoming buses is to 
be connected to which of the outgoing buses so 
that each of the frames in memory 210 can be 
processed according to the address sequence in a 

. different one of the address sets as the operation is 
recycled. Similarly, each of the arithmetic circuits 
212 is connecte.d to a specific dedicated bus 214, 
which mux 216 selectively interconnects with buses 
218 in order to permit different frames in memory 
210 to be processed by different arithmetic circuits 
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during each cycle of operation. Although this sys- 
tem does accomplish a pipefine type of simulta- 
neous processing without having to actually move 
the frames of data, it suffers from the shortcoming 
that it requires two complex multiplexers 206 and 
216, each of which contains massive switching 
capability. 

According to this invention, a much simpler 
and more hardware-efficient system can be con- 
structed by providing an address generator 22a 
which includes a plurality of address sets, each of 
which is connected by a different bus 40a to one of 
the data sets in image data bank 24a~ Similarly, 
arithmetic unit 26a includes a plurality of arithmetic 
circuits which are interconnected with the data sets 
in image data bank 24a by means of a plurality of 
buses 42a. However, in accordance with this inven- 
tion, no multiplexers are needed. For after a cycle 
of .operation is completed, i.e.. each frame has 
received the sequence of addresses from its asso- 
ciated address set in address generator 22a over 
the corresponding dedicated bus 40a and the pixel 
data has been processed in accordance with that 
address sequence by the associated arithmetic cir- 
cuit in arithmetic unit 26a, the entire address gen- 
erator can be reshuffled so that each of the ad- 
dress sets changes place and a similar reconfigura- 
tion can be accomplished with respect to .tiie 
arithmetic circuits in arithmetic unit 26a. Thus the 
pipeline or parallel processing has been accom- 
plished without moving the data sets and yet with- 
. out requiring the complex and massrye multiplexing 
capability of the prior art 

Although specific features of. the invention are 
shown in some drawings and not others, this is for 
convenience only as each feature may be com- 
bined with any or all of the other features in accor- 
dance with the invention. 

Other embodiments wfll occur to those skilled 
in the art and are within the following claims: 

Claims ,. 

1. A reconfigurable sequential processor compris- 
ing: - 

a data bank for storing data to be pro- 



a programmable logic block address flen^ 
erator for addressing data in said data bank; 

a programmable logic • block arithihetic 
unit, responsive'to said data bank, for process- 
ing the data addressed by said prpgrammable 
logic block address generator; 

■ 9 ah address generator hardware configura- 
tion file having a plurality of configuration files 
for configuring said programmable logic block 
address generator in one of a plurality of ad- 

i dressing configurations in response to an ad- 



dress operational code; 

an arithmetic hardware configuration i file 
having a plurality of configuration files for con- 
figuring said programmable logic block 
5 arithmetic unit in one of a plurality of process- 

ing configurations in response to an arithmetic 
operational code; and 

means for delivering a series of operation- 
al codes to each configuration file for enabling 
10 said programmable logic block address gener- 

ator and said programmable logic block unit to 
, be configured to perform sequentially a cor- 
responding series of arithmetic logic oper- 
ations on said data in said data bank. 
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2. The reconfigurable sequential processor of 
claim 1 in which said programmable logic 
blocks are programmable gate arrays. 

a The reconfigurable sequential processor of 
claim 1 in which said means for delivering said 
operational codes includes an operational code 
register for storing the operational code of the 
next configuration for each of said logic blocks, 
and decoder means, responsive to said next 
operational code^ for selecting from said hard- 
ware configuration ffles the file corresponding 
to said operational code. 

4. The reconfigurable sequential processor of 
claim 1 in which said means for delivering said 

.-. ~ address generator includes a plurality of recon- 
. figurable address sets. 

5. The reconfigurable sequential processor of 
claim 4 in which said arithmetic unit includes a 
plurality of reconfigurable arithmetic circuits. 

6. The reconfigurable sequential processor of 
claim 5 in which sa^d data bank includes a 
plurality of sets of data 

7. The reconfigurable sequential processor of 
claim 6 further including a plurality of buses for 
interconnecting each of said address sets and 
arithmetic units with a corresponding one of 
said data sets. : 
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@ A reconfigurable sequential processor includes a 
data bank for storing data to be processed; a prog- 
rammable logic block address generator for address- 
ing data in the data bank; a programmable logic 
block arithmetic unit responsive Id the data bank for 
processing the data addressed by trie programmable 
logic block address generator; an address generator 
. hardware configuration file having a plurality of con- 
figuration files for configuring the programmable log* 
ic block address generator in one of a plurality of 
addressing configurations in response to an address 
operational code; an arithmetic hardware configura- 
tion file having a plurality of configuration files for 
configuring the programmable logic block arithmetic 
unit in one of a plurality of processing configurations 
in response to an arithmetic operational code; and 
means for delivering a series of operational codes to 
each configuration ffle for enabling the program-' 
mable logic block address generator and the prog- 
rammable logic block arithmetic unit to be config- 
ured to perform sequentially a corresponding series 
of arithmetic logic operations on the data in the data 
bank.. 
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